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(57) Abstract: It is possible to provide 
a makeup simulation technique enabling 
a user having no special knowledge 
to obtain a simulation image of a high 
quality at high speed with a simple 
operation. A makeup simulation device 
includes: a first image creation unit 
(20) for creating n layer images of 
normalized transparency in which 
transparency degree of each pixel is 
normalized according to n layer images 
contained in a use reference image; 
a second image creation unit (30) for 
creating n color-converted layer images 
by subjecting the frame image to the 
color conversion processing by using 
the color component of the layer image; 
a mesh setting section (50) for setting 
a mesh in each face area in the frame 
image and the makeup pattern image; 
an image deformation unit (60) for 
calculating a difference between the 
mesh vertexes set in the both images and 
deforming the makeup element image 
in the layer image of the normalized 
transparency according to the difference 
so as to match with the face area in the 
frame image; and a synthesis unit (70) 
for synthesizing the color-converted 
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[0084] m4iZ.7^iry^'T^yy'S12iZ.m^X. ^2p{5LM^mtl5521fi. J^y^^yy'SStmmi^V 
[0085] :^T^y^S13K^\^^X. #^;^ttm§P522«, :^Ty:fS6tmm^\^X. :7U—M. 

4^^5ov^T. wm.^Mm^\^522i^^ ^Ty^s7tmm\^i^x. '7v—j>m^(DmmM 

[0086] y^'Ty:fS15lC^\^^X. #^.'^ttm§l3522f*. y^'ryy'SStmm^VX, 

m. m. Bs. Rua(Dm$mi-F4^^hwmuTpmi7x%^m)^^tiiir:5o 

[0087] ;:^7^5/7"S16tC:j3V ^T. lB.'^#«]§|554f*, P^7"iy7°S9i!lKH^^ Mp^i'i^^t^^^ 

mmmmmmziML^xm(D\^^7!)m^tvtim^xh. m=^i^(Dm:^^w^\:^^j:^ 

[0088] ::^7^5/7°S17^;I:^oV^-C. jM^tML|f|561(i. 'K>mSM#i;i^S$tL/o<5'iX^& 

[0089] :^Ty:fSl8{c^\ ^-C. ^btt^5^ili^^?l^§|563(*. m^^i^T^— ://v^#fi^U 

^^L-CV>§o 11118(a) t^^i-J;5t-. ^bl!±S^ilff^Gl^5jgji|§;jxfc/KyriVPRl^s 
. (b) K^-rX^K. :^V:=^lyPR2^Z.m^^i^h. ^tli^i^^X. ^fbffi^^W^Gl^Mb 

[0090] H4(c:^i-v?>7"5/:/si9};i*3V^T. -fe^m^a§P32}*. ;^^5/y^siiT*tttli$tb^c 
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)-^(5) icTsk-r^^m^M^mu n^s:(D^^mw-v— w^^^^^-r^o -ft^^ 
[0092] ikK. mmmEm\:M22mmmm. « mfmrnmi- « ^iEUit-r^m^ i^ov ^ 

i i 

[0093] [#:4] 

Q={(l-ai)Q +aiCi} (l~a2) + a2"C2 ••-^(10) 
=(l- Gt i) (1- a 2)Q + a 1 (1- a 2)^ + a 2C2 

Q = {n(l-ai)}Cf +i [{o^j.n (l-aj)}q] •••^(11) 

i=l 1=1 

fib. cr-<^h/v}i^^^(D#iii*(7)R, G, B\m:^^oC^^vM^^mwmm 

f 

i 

T 

T 

i i 
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o 

[0095] :p^T^y:fS2Uz.^\ ^^lfB80«. ^^^TOKX^^^^tvfcm^^m^ir^^o 
[0096] m4ic^ir:^T-yys22izm^x. :7w— i^ii^^^imlfl542^i, ^:7w— AW^c>^i 

[0098] -^hK, mmm\^^^—m^(o^nm(ommmjstx^mm^(o^nm(ommm: 
[0099] mm\iLmM\i^n(Dwmfmm 
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$15511, 52mm— ^^^fci^. mm^m^mn5ii(D^mmir:6o mm^m^m 

U511l^^ ^^:ttii:^^m^l01^ ^#SigTMa$|3l02. +BM{giif#^^fl5103 
. #»]g|5l04. M#g|5l05. ;^mg|5l06^#x.TV>§o 

[0100] ^^^uv^mm^iout^ 

[0101] ^^'ilS<ST^a§|3102{*. ^:7;^nv'|li'il^0fSfT^^^J(OW^^^bJfeS>^n5/i^ 

[0102] mmmmm.^0.mo3i-i. m^&i^i^i&r^nfc^y^i-^-^^mm^Mu mmm 

[0103] #«j§pi04{*. :felS^Mm#l-*5V>T:feBS^^i-^«i!. ;&ISffiMm#f;i 
[0104] ms$|5i05{*. #«]gpl04^clJ:oT#llJ$t^fc;&BS^M^^^^i^^^^ :fcBS+BMffiW 

-So 

[0105] ^m$pio6{*. -a^^M#(;i*3VNT. 3Ss^50fS(^««9iev>'^^^^t±iu mm 
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[0106] mm^m^mn(Dmm 

ir^^u av^fp^^ij^s^5^sv^^^^^L-cv^§o ^ti. m22i^&m(D2mxm^ 

[0107] y^'T^y:fS202lcm^X. ^#StST^3g|F|5102f*. '=e:7^u-Jm^iCML-Xm^ 
xm.=360X240Xh^(DKM\^X. mx^=30X20t^th^o ^cC*5. ^<Df-^Xf* 

. imm^mim'^<D±^:^Kfj:^^t^m^L-x\^^o 

[0108] >^y"5/>^S203lCl*5V>T. ^M^^^^i^#^^$P103^*. ^#S;^5|£T$tl./c>(=BM'ffi 
?^gH*^U :fcAT^*0S1=SMffi:7^/^^^fflV>T. Max(P, Q) X5-(A+B+C 

+D+E) • • -^(1) (Dmw^n^\ n mm(D^mm^^ib^^tKx^^ &Rxf 

i-^^^/]^i^X:h^o 

[0110] Bl24{*. ^vi—^VW<^—l^m^ttERXf:^m^—:fy/l-^<i^—:^mm.t^^l.ti 
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[0111] E|25{*. M^*bfcglB-efe«9. (a) {*M;a5^gV^TV^/ceV^J^, (b) 

) , (b) {c^-rmmm^hm^&^^nmmii^^mu ^mufc^^Ri^sf^. m 

ttmi-^r^d^-e^^fci^.'^^i^^bMW^^ffl-r^r^^^-e^^o b;o^u (Wk 
^^mir^^tit-x^f^w ^^x\ ^m^^mmmt, ^^n—^</u^<^^>-m^GP 
tKxv).mT(im^^x\^^^^^—j>>mm.KML-xhmm^^mir^^t^-^mti^x\^ 

•So 

[0113] fj:io^ ^(1) m^oV^-CMAXCP, Q)(D^i^Q;e»S^*tL-CV^-5/ci6. ^TV ^;5 

m^ic^i'f)5m(Dmmm&i()^^hicmii>ibtix\^ 

[0114] 026{te^tJ?;6-BS>|^Pfltillf#<^-'0SJ^*b/cEIBT*$>«9. (a){telS>ilPW 

^^^U (b){i;&BS^ePf^t^l^^^^bTv^§o (a)^u?(b){^*DV^-c. 

xi'i.mm^M}^^ir^mm^3(Dmmmm<wm^fhx\^^^^t7i^^^^^o (b 
) K^-rx^K^fimmimmxi^^ :^mi^Mf^^ir^mm-R4(Dmmmm<wm^ 

nx\^^^^t^^^f)^^o 

[0115] El21^^^i-><^7^5/:/S204(^*5V^-C. #t!]§Pl04fi, :fcBS^@SlffiW#(^#W^(0 

^wvui^^ ^m^'^^tmc^ :^mmmmmW(D^mm(Dmmi^m24x^irm 
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[0116] #II]tPl04t^j;oT#S!]$;rifc:fc^tJ^^;&BS^BlMfeilf^^^i-Ha-efe«9 
[0117] m21K^ir::^Tiyy'S205K^\^^X. MM:^105i^. WT^^-^V/VTtlW^Wi^flfz. 

mmmmm^t^^-<^v;vj^2m^m-^fiftMmmmmm^tKn\^x^±m'7 

8(a). {h)iC^i-X^K^ 11127(a). (h)iC^\,^X^ &RXl:^fi§:^^irmMiR3, R4 

[0118] Bl2i(;i^f ^7"5/:/S206(;l*DV^-c. mfi^piosfi. &^t^^;&>f@SlfSiii#<Z)>c«fj^; 

mm^Mvm^'ij'Wmm^^mwu:^T^y^s207) . ^^w#4J<Djir^t-tB^^i- 
[0119] Bi29{*. m^'t-m^m^^Bvtimmxh^o m29K^irx^K^ m^'t-wm 
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[0120] :^'T^yy's208K^\^x. ^m^ioei^, m^'t-n^mm^x^^^/^^^mT^m 

mm:mmkm\^fzM^. Mra^*'^m■rv^/^v^^-r§. m^^\'mm(D^mm^mi 
[0121] ^(DX9K. mmi^Lm^m^5i2, 522Kxtnt. iERximmiuy^/^^ii^^^:^ 

i^t(Dmm^^irmi^^^)^ir^m^i^it^x. mmmm^. m4^m(Dm 
xh. mmi^n^^ir^i^mic^^^^xm^^mm^^ir^f^mm.^n^^t^^x^^o ^ 

[0122] (^PW^^t^^-K) 

if^ituiy^^^^—^yB:ymm:(7)mmy^vy^mxh^o mmmm'ff^^—n^^n^ 

2. W-¥-iii#f^fife§|5303. ^gg^SWir— W#f^^g|5304. -feW-^-f^^lfP3 

05. mm&jEm^msoe. iEm^tmmm^-(^—m^mmmo7^ ^mm^m^ 

308. -fe^i^Wi'— M#tElSg|5309. -^^§15310. ^^g|3311. RXfmmmm^ 
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[0123] m-^tmmMnmom. m-itm:»?^9i la^^hmm^ti. mmm^(D^'T/]^tfi:^ 
[0124] u4^—mm¥)^^303i^. ^—^{z.x^m(Dm^m^±i^imm(D^tm^mm 

[0125] mm&u4^—mm¥^^304i^^ m2izmirmm&^y4^—mm¥)^^2itm 

[0126] mmmiEm^m306it^ m2K^i-mmmiEm^m22tmmK. mmmy^^— 
-r^ttu^. ^±m^(D^mm\^n\^^i.2)(D'^%^m\^. w^±m^(D^mm(D 
[0127] ^mtmmmy-(^—mmm'mn307\'t^ nAMAf)^hmm.^fi. lEmtmmmy 

m<DR, G, Bm^^fh^fhYiSYm'^^\^^mJtM.±M'^{3)—^{^)K^ir 
[0128] -fe^^W-^— m#tBll§P309{i. RAM4;6^^>«^$tl.^ 'fe^i^Ma$|3308(^j; 

[0129] -^^§15310}*. m2KBir^^motmmi^. iEm^tmmm^4^—mm.(D^m 
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[0130] ^^ti53ii{*. m^mme^^hm^^ti. ^^^3ioiz.x<^x^)3^^tifcmj^^m 
[0131] m^. mmmm¥f3^'^—}'i^^n^ihm^^^^^—^^3>mm<^W}m^-^^^x. m 

[0132] ;^7"5/:/S302tC^3V ^-C. Wir— HM'^^§l5303fi, ^f^fP302^^b-C. 
[0133] MJ^-a^. W-¥— ®#f^^§|5303f*. #ihllf^^#§|5301(Cj;o-C^#$ttfc 

^-^^i^^yvm^m^^^xmm^fifiimmmm^^nm-f^o m-fHnhfifz.im.^m 
^^^^^(Dmmi-i^—^(Dm^i^x<>xnt^i^ti^o 

[0134] r(^^|5^(c:*3V^T. ^^fP311(;i{*. mm&t^ W-^<D^^^tiCXoXm^tlfc 

[0135] ><.7^5/:/S304tc:}3V^-c. if l;iJ;«9;=<.7^5^:/S303-ef^^$ttfcW-¥— 

i-^m^;55A;'a$ti.^.ev>#'a'{* (;^7"5^7°S304-eNO) , ^a;OS;^7^5/:7°S305f::3t 



[0136] ;^^5/>^S305lc*5V>T. if }c:j;«9^2pf^^^— KcDi^T(om^^5$ti.fd 
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[0138] >'>7^5/>^S3081c1*dV>T. ^KSiE^^k$|5306{*. ^S^SW-^— ®#<D#lif* 

m^bSe^SWir— W^fBllg|5307tcfait$-&^o 

[0139] >^^^^:/S309l;i*5V>T. 'fe^mMa$B308fi. 'feWi'— ^^ihH^ir^Sf;!. 1/ 

tEtefP 30 9 tCtaH^-lir^So 
[0140] ;:^7^5'7'S310tC:i3V^-C. 'a^^g|5310(*, #ih®#^, -fe^i^W-t— ®^^^T/V 

[0141] ;^^5/>^S312tc*5V>T. ^— iFjc:j;«9KW#(^)f^^it^^5$ti.6^(;^7^5/^S3 
12T*YES). ;?<.7^5^::/S3l3t;iii^. SW'a^f^^fP3l2}*. W-¥— H#f^^lf|53 

03tiJ:oT{tj?fe$tbfcWir— ®f^<b^ihiif#^#§P301tiJ;o-C^#$tb/c^-ih 

[0142] —iy. >^^5/:/S3121;i*dV>T. if ^c:J;^9KW^(Df^^jt*;$s$t^Jfev^J^'^ 

(;^7"5/:7°s3i2-eNO) . ^m^^:^'Ty:fS302izm^ti^o 

[0143] /^:io, Tic^Bjfi. }^r(Dmm^WimL-xhx\^ \ 
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[0145] (2) ±mmm<Dj^m'x^i'i. w-^— w^f*. imm(D^\^ummm^^^ts'h<Dti. 

o 

[0146] (3) ±mmM(Dj^mXi^. #il:®#^#Ih®;^7<911a-e^#bTV^fc;^|S. ^flK 
[0147] 

(1) n (ni^lE(Dmm ^^(^ W-^— W^^l^ScOMH^^^^6>«^$tvS^^H^ 
<Z)#>*r(D^P^S^^SU ^Sb^c^P^S^ffiV^T. tufEv^5^1/-i/3^^Iif# 
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[0148] ^(7)«^tcj;tL{i\ mi^fmm^xm^aM^j:im^mmm^m:^ti 
[0149] (2) ^tc^ mmmi<^mm'f)^^m-i. mm^4^-mm^^'&^titc^mm(Dm 

[0150] ^PJSW-^-iii#(^^W3^(OMKS^5Em^b$*xTV>5fc 

[0151] (3)tiflBm2(D®^<t^#^fi, ^^4^—nm.(0^)^^:kmJ-mW^^^^—^ya 
H =H •••^(A) 

r c 

S =0. 8XS +0. 2XS •••^(B) 

r f c 

V =0. 8XV +0. 2XV •••^(C) 

r f c 

ffib. H , S , V }i W-^^Mf^cD-fe^^cDHSVfii^^L. S , V v^^^^— 

c c c f f 

>'MMMj^(D^m^(DHSVilM.^^l., H , S , V {*||2(D®'^<Z)#®^OHSV'fS 

r r r 

[0152] M«^(;ij:tt{i^ -yK^u—-yB>MMm^(Dmm-m&^:h^nmmmvti^-^ 
[0153] (4) mm?^^yiy^mm^m^. m<D!i^mmti:^mimm^tif:iwmmut. ^(d 
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o 

[0155] [M 

?i= - ^ ( I vl-^ I - lij)(K-^) • • • ^(D) 

p^f + X ( I pi^pT I - lijXPi-^-) • • • ^(E) 

i j i 

i i j 

i ij i j 

[0156] mm?^^yi^^(D^mMM(D^^^m\.-^-^. ^5/v^^^«^ 

[0157] (6) tifSE**P{55:e^t±i#^«. :^:^<Dum:^mm^^t$mmt^h^i:ummm 
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mmM:^mmmmmm.\'^. mmMm^tmm^tcDmmmmm^i^^xm 
[0159] ^LT. &mm:^^mmmmmm.(7)^^ <^i«v ^mm^^-rmmm w\xmf^^ 

[0160] rr-e. m^Ru^m.my\m^(D^^ i)^. m^mi^m^^nw^x^ ^^m^. m 

^^^m^'^xm&ir^t, ms:$tLfciif#«MJ-i^v ^^m^^-r^ttf^^o 
[0161] -ij. mmx^^mm}fm^<D^^ t^k mm-a^^m^^mvx\^ ^^ccv & 

[0162] ^(Dfc.}^^ mKRxf^^mmm^^mmiir^^^txmhtif^imm^hm^^^m 
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[0163] (7) mmmmiumi^^i^^^n. mmmmm^Mi^x^^^t-^iy^m^mu m 

[0164] mmKM\^xnm^m^m^^^M^^^'e^:tT^i^mmiim 

mmm^h&mRxf^mmmimim'^^)^^nx\^^^fc^.m^Rxf^mm}im 
m.tmmm.t(Dmm^^'ojEmi^^irnmiumi^^n^^t^^x^^o 
[0165] (8) mmmmmmm.^^^m'i. w-m^y^i-T^i^^m^rnvrdrnm^Mu Mje: 

[0166] ^y:tni^^m:dm^tifcmmmcMu mcmw.&^i&r^ 

•^^mmiim^tix\^ ^^fcib. m§iRxf^mmmmm^^mmK^^ir^^t^^x 

[0167] (9) mmmmmmumsi^m'i. mmmmmmm^m^i^Kxmm^titim^ 

mt(Dm^xmm^7jkir&mRxf>^mnmmm^^n^^t^^x^.^mm&^ 
[0169] (10) mmmmmm^MSi^m^. mmmmmmm.^m^m^xmm^fhti& 

[0170] ^(Dmmi^^tn^.tEmRxf^mmmmmmmi^xm^^^mm^^irmm^m 
±ir^mmi)m^n. mmmiwmmm^^tix\^^f:i}^^ tEmRn^mm}T-m 
m^A^^<m'^^tix\ mmmmm^M\^x^mR-c^m^-^^±^<m^ 
i^xv^^m^xhoxh. M\^^m^^'rmi^^^'om&x<M^^-^^^t^^x^^ 
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[0171] {iDmmmmmm^msi^m^. mm^mmm^^m^m^x'o^m^tifcm 

[0172] mrmj&(Dmmimm<ir^^mmf^<^i^^^tii^. m^R 

[0173] {i2)mm^y^^i—^yB>^M0imm~i. mm^^(D^y^—jmux^^^tt,m 

[0175] {i^)^^m\z.^^i\m>'^^'\y—^^B:ymm'^. n{nmE(Dm:m^(r>\^^^—m 
^^bttv^^^i^-v^H^gg-efeoT. wmwmnmximmu^i)tvxxts-^fhfz. 

fi^(Dmmm^m^'r^^o K^n^^^^mn^^^t. mmi^^^^—i^s^M^m 
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[0177] (14) K7f}^^^:5^[:,m->5.^U—iy3l^ijmi-i. n (nitlEcDmWO ^(DU^^— 

tiitE=3^fcv-^(*, mi(Dmm.i¥}^^^s M^mm.m^^^. ^^/^^^^^^ 
m^^^. m2(Dm^ff0.^^. Rx^-^m.^^^mK.. mmmi<Dm^ff^^ 
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tiff BSM^^tJ^tu fBi/5::xW— v^3^>ff aB#(D^ ^ i^lS^^t^f^^ 
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^{ci^bT^(A)-^(c) KTT^^^^mmm.^'mfx^. #^>ti.fcw#^Hsv^fe 

H =H •••^(A) 

r c 

S =0. 8XS +0. 2XS •••^(B) 

r f c 

V =0. 8XV +0. 2XV •••^(C) 

r f c 

{ab. H , S , V {*W-¥— W^(^fe^^(DHSV{fi^^b. S , V v-H 

c c c f f 

:^>i?J-^W'^(D#llf^(DHSV'fii^^b. H , S , V {*||2(Dllf#<^#lif3^(^HSV'f|£ 

r r r 

[4] tijtB7<5/v'at.ig:s^^fi, 

[5] Bmmwi^m^m%. mmnm?^^y^y^<D^M!^^. mmMtw^^ir^m-^)^^^ 
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P^i= - X ( I ^ Pj^ I - lij)(K-Pj) • • • ^(D) 

?f + X ( I PtpT I - lij)(Pi-Pj) • • • ^<E) 

1 j 1 

i i j 

j ij i j 

[6] mm^mi^Lm^m^^ii. 
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[11] mmmmmmmmsi^mt. mmmmmmm.^W}^m^xmm^fhfcmm& 
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